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Abstract — This article is concerned with decentralized sequen- 
tial testing of a normal mean /x with two-sided alternatives. It 
is assumed that in a single-sensor network system with limited 
local memory, i.i.d. normal raw observations are observed at 
the local sensor, and quantized into binary messages that are 
sent to the fusion center, which makes a final decision between 
the null hypothesis Ho : /x = and the alternative hypothesis 
Hi : n = ±1. We propose a decentralized sequential test 
using the idea of tandem quantizers (or equivalently, a one- 
shot feedback). Surprisingly, our proposed test only uses the 
quantizers of the form /(X„ > A), but it is shown to be 
asymptotically Bayes. Moreover, by adopting the principle of 
invariance, we also investigate decentralized invariant tests with 
the stationary quantizers of the form 7(|X„| > A), and show 
that A = 0.5 only leads to a suboptimal decentralized invariant 
sequential test. Numerical simulations are conducted to support 
our arguments. 

I. Introduction 

Decentralized sequential detection has many important ap- 
plications such as signal detection and sensor networks, see, 
for example, Blum, Kassam, and Poor [1]. Veeravalli, Basar, 
and Poor [7] characterizes the Bayesian solutions in the system 
with limited local memory and full feedback. Recently Mei 
[5] develops the first complete asymptotic theory for decen- 
tralized sequential detection. However, existing research only 
focuses on the simplest model when both null and alternative 
hypotheses are completely specified. 

In this article, we will consider a more flexible model of 
decentralized sequential detection in which hypotheses are 
composite. To highlight our main ideas, we focus on the 
following specific problem in a single-sensor network system, 
since the extension to the system with multiple (condition- 
ally independent) sensors is straightforward. Assume that the 
single local sensor observes a sequence of raw observations 
Xi,X2, - ■ ■ over time n and the X„'s are i.i.d. having a normal 
distribution N{pi,l). Suppose we are interested in testing 



Hq : ^ — versus Hi : ji ~ ±1. 



(1) 



In the centralized context, one uses the raw observations Xi\ 
to decide which of Hq and Hi is true, and such a problem 
has been well studied in the mature field of sequential analysis 
(Wald [9]). In the context of decentralized detection, due to 
data compression and communication constraints, the local 
sensor needs to quantize the data X„'s and send a binary 
message [/„ e {0, 1} to the fusion center, which then utilize 



the quantized messages J7„'s to decide which of Hq and Hi is 
true. Following Veeravalli, Basar, and Poor [7] and Mei [5], it 
is assumed that at time n, the quantized message L/„ sent from 
the sensor to the fusion center only depends on the current raw 
observation X„ and possibly feedback from the fusion center 
In other words, at time n, quantized message C/„ satisfies 



Un ^ MXn;Vn-i) e{0,l}, 



(2) 



where the feedback Vn-i only depends on past sen- 
sor messages: Vn^i = V'nl^i.n-i]); where [/[i.„_i] = 
([/i,...,i7„_i). 

In the decentralized sequential detection problems, one 
wants to determine how to design sensor quantizers in 
(|2]i and how to make a sequential decision at the fusion center, 
so that the overall performance of the system is optimal (in 
some suitable senses). A central challenge is to determine 
the form of (binary) quantizers (/i„'s for (asymptotically) 
optimal decentralized tests. In the simplest model when both 
null and alternative hypotheses are completely specified, the 
best quantizers are of the form of monotone likelihood ratio 
quantizers (MLRQ), see Tsitsiklis [6], and take the following 
simple form in the case of testing normal means: 



= I{X > A). 



(3) 



When the hypothesis is composite, the MLRQ is no longer 
applicable. In particular, it is unclear whether the quantizers 
in (|3]l still lead to (asymptotically) optimal decentralized 
solutions when testing the hypotheses in ([T]i. Indeed, our 
intuition may suggest us that a (more) attractive candidate 
can be (f){X) = I{\X\ < 0.5), or more generally, (t){X) — 
I{Xi < X < A2). Moreover, it is unclear whether other more 
complicated quantizers are necessary or not. 

In this article, we tackle the form of binary quantizers by 
using the concept of unambiguous likelihood quantizer (ULQ) 
proposed by Tsitsiklis [6] (the MLRQ is a special case of 
ULQ). Surprisingly, by combining the ULQ with the idea 
of tandem quantizer in Mei [5], we show that at most one 
switch between two different quantizers of the form in (|3]l is 
sufficient to construct the asymptotically optimal decentralized 
sequential test when testing the composite hypotheses in ([TJ. 

Observing the symmetries of the densities, it is also nat- 
ural to adopt the principle of invariance (see, for example, 
Lehmann [4]). Specifically, if we consider |X„|, the problem 
of testing hypothesis in ([T]l becomes one of testing a simple 



null versus a simple alternative hypothesis on This 
viewpoint allows us to apply the asymptotic theory in Mei 
[5] to investigate decentralized invariant sequential tests. It 
is interesting to note that among stationary quantizers of the 
form (f>{X) = Ii\X\ > A), the intuitive choice of A = 0.5 
leads suboptimal decentralized invariant sequential tests. 

The remainder of this article is organized as follows. Section 
II provides a formal mathematical formulation of decentralized 
sequential hypothesis testing problem. In Section III, we 
propose a family of decentralized sequential tests, and proves 
its asymptotic optimality properties. The nontrivial part of 
the proof is in Subsection III.C, which characterize optimal 
quantizers via unambiguous likelihood quantizers (ULQ). Sec- 
tion IV focuses on the decentralized invariant sequential tests. 
Section V reports numerical simulations. 

II. Problem Formulation 

Assume that the raw data Xi,X2,--- are i.i.d. with 
iV(yLt, 1), and suppose that over time n, the quantized message 
Un € {0, 1}, defined in (O, only depends on Xn and possibly 
Vn~i, a feedback summarizing past history of all quantized 
messages C/[i_„_i]. Here we intentionally do not put any 
restrictions on the range or frequency of the feedback 
as it turns out that a simple one-shot feedback is sufficient to 
construct an asymptotic optimal solution. 

For three hypotheses in ([TJ, denote by /, gi and 52 the 
probability densities of Ar„'s when /i = 0, —1, 1 respectively. 
Also denote the corresponding probability measures and ex- 
pectations by {P/,E/}, {Pgj^jEgj} and {Pg^jEgj}. Assume a 
priori distribution tt = (tt/, tt^j^ , 77^2) is assigned to the three 
states of nature, and let 

2 2 

i=l i=l 

To characterize a decentralized sequential test 5, denote by 
N the time when the test & decides to stop taking observations, 
i.e., TV is the sample size of 5. Once stopped, the test (the 
fusion center) makes a decision d E {0, 1}, corresponding to 
Hq and Hi, based on the information it receives up to that 
time. In summary, a decentralized sequential test S includes a 
sequence of quantizers {(pi, (f>2, ■ ■ ■}, a sequence of feedback 
functions {V'l, "02, ■ ■ • }, a stopping time N at the fusion center, 
and a decision function d e {0, 1}. 

As in Wald [9] and Veeravalli, Basar, and Poor [7], define 
a Bayes risk of a decentralized sequential test S as 

TZ,iS)^nf[cEf{N) + WfPf{d^l}] 
2 

+ ^9. [cEg. {N) + WgV,^ {d = 0}] , (4) 

i=l 

with c the incremental cost of each sample and 
{W/, , Wgj} cost of making incorrect decisions. 
The Bayes formulation of decentralized sequential hypothesis 
testing problems can then be stated as follows. 



Problem (PI): Minimize the Bayes risk TZc{5) in ^ among 
all possible decentrahzed sequential tests. 

Let Sg{c) denote a Bayes solution to the decentralized 
sequential detection problem, i.e., (5^(c) = a.rgnimg{Tlc{S)} . 
Since it is extremely difficult, if possible at all, to find the 
exact form of Sg (c) when hypotheses are composite, we adopt 
the asymptotically optimal approach, i.e., to find a family of 
decentralized tests {(5(c)} such that 

lim7^e(<5^(c))/7^e(<5(c)) = l. 

c—>0 

III. Our Proposed Test Si{c) 

In this section we propose a family of tests {Sj{c)} that 
is asymptotically Bayes. Our proposed test is a two-stage 
procedure, and it assumes that the fusion center will send a 
one-shot feedback V taking values in {0, 1, 2}, representing a 
preliminary decision on f,gi or 172 ■ 

A. Definition of Test S J (c). 

Our proposed test 6j{c) is defined as follows. 

1) First Stage: Choose positive values u{c) < 1/2 satisfying 

,(,)_0 and i^^o. (5) 
lege 

In the first stage, the local sensor quantizes the raw data X„'s 
by a stationary quantizer ~ I{X > 0). Based on the 

quantized message [/„ — ip'^{Xn) at each time n, the fusion 
center updates the posterior distribution of the three densities 
iTTf,n,T^gi,n,T^g2,n) recursively. For example when [/„ = 1, 

^ 7r/,„, !?/([/„ ^ 1) 

The fusion center stops the first stage at time 

iVi = min{7i > 1 : max{7r/^„, TTg^^n, TTg^^n} > l-u{c)}, 

and makes a preliminary decision e {/, gi, 32} at time A'^i 
satisfying 

2) Second Stage: In this stage, it is essential for the sensor 
to switch to one of the following three "optimal" quantizers, 
depending on the preliminary decision of the fusion center in 
the first stage: 

rf{X) - I{X>0); 
.pl^iX) = /(X > -0.7941); 
rg,{X) = /(^> 0.7941). 

Specifically, after the fusion center stops at the first stage, it 
will send its preliminary decision G {/, gi, 32} back to the 
local sensor as a one-shot feedback V. Then the local sensor 
switch to the above optimal quantizer and use it for all 
incoming raw data. 

In the second stage, the fusion center continues to 
recursively update the posterior distributions with data 



Uni+i,Uni+2, ■ ■ ■ and it decides to stop the second stage 
at time 

N = min{n > ^ : ^/^'"^^^^^ ^ (c, 1)} 

with a final decision d = (d = 1) if upper (lower) bound is 
crossed. 

B. Asymptotic Optimality of Si (c). 

The asymptotic optimality properties of test 5/(c) are sum- 
marized in the following theorem and its corollary: 

Theorem 1. For any decentralized sequential tests {6(c)}, if 
P ^{decision incorrect) — O(clogc), (6) 

for Lp G {/, <7i,52}, then the stopping time N of 5{c) satisfies 
Ef{N) > (1 + o(l))| logc|/0.3137 
£si(iV) > (l + o(l))|logc|/0.3186 (7) 
£9.W> (l + o(l))|logc|/0.3186, 

and our proposed tests {(5/(c)} attain all three lower bounds 
in ([7| simultaneously. 

Corollary 1. Tests {(5/(c)} are asymptotically Bayes. More- 
over, both {(^/(c)} and Bayes solution 5*g{c) satisfy as c — > 0, 



nc{5i{c)) = c|logc|(l + o(l)) 



-0.3137 0.3186 
Note that the asymptotic optimality properties in Theorem [T| 
do not depend on either the priori distribution tt or the loss for 
incorrect decisions {Wf,Wg^,Wg^}. This is consistent with 
the centralized sequential hypothesis testing, see, Chernoff [2]. 

Before proving Theorem [T] let us first introduce some 
necessary notation. Denote by $ the set of deterministic 
quantizers that consists of all (deterministic) measurable func- 
tions from R to {0, 1}. Define a "random quantizer" as a 
probability measure that assigns certain masses {pi] on a finite 
subset e $, and denote by $ the set of all quantizers, 
deterministic or random. Note that a deterministic quantizer 
can be thought of as a special case of random quantizer that 
assigns a probability of 1 to itself. 

In the context of decentralized detection, we adopt the fol- 
lowing implementation for a random quantizer (j) : The fusion 
center first selects a deterministic quantizer (/i e $ randomly 
according to the probability measure {pi} assigned by 0, and 
then the local sensor quantizes the raw data by the chosen 
deterministic quantizer cj). Such a procedure repeats whenever 
the local sensor uses to quantize a new raw observation. We 
want to emphasize that it is essential to assume that if a random 
quantizer (j) is applied, the fusion center retains the information 
about which deterministic quantizer it chooses (otherwise the 
fusion center will lose significant information). 

Observe that for a given deterministic quantizer </>, the K-L 
information number I'^{f,gi) is 



lHf,9i)^J2^fWX)^t)log 



PfWx) = t) 

Fg,{cf>{X)=t) 



With our implementation of random quantizers, for a given 
random quantizer (f> that assigns probability mass pi, . . . ,pn 
onto 01, ... , (pn, it is easy to see that the corresponding K-L 
information number I'^{f,gi) (at the fusion center) is 



(8) 



Similarly, we can also define the quantities /"^(Z, 172), 
lHf,92), or I^{g^,f), IH9^J) for J = 1,2. 

We are now ready to rigorously define the optimal quan- 
tizers and the corresponding K-L information number. Define 
the optimal quantizer with respect to gi as 

0s. = argsup{/'^(5j,/)}, i = 1,2 

and define the optimal quantizer with respect to / as 

0/ = argsup{min{/^(/,.gi),/^(/,g2)}}. (9) 

Moreover, define the corresponding K-L information num- 
ber of these two quantizers as Ig^ = I'^si {gi, f), i — 1,2 and 
7/=min{/^/(/,gi),/^/(/,52)}. 

With these notation, let us state the following proposition 
without proof, as it is just a special case of Theorem 2 of 
Chernoff [2] and Section V of Kiefer and Sacks [3]. 

Proposition 1. For decentralized sequential tests {5{c)} sat- 
isfying in Theorem\l\ for ip € {/, gi, 32}, fli c — > 0, 



E^{N) < (1 



o(l))|logc|//^ 



(10) 



To achieve the lower bounds in ( liQI ) simultaneously, one only 
needs to use the two-stage procedure as described in Section 
\lIl\for test Si (c), but for the second stage, and (jy^^ 

should be substituted by the optimal (random) quantizers 0/, 
and (j)g2 respectively. 

A comparison of Theorem [T] and Proposition [T| shows that 
to prove Theorem [T] it suffices to show that in the context of 
testing a normal mean stated in ([T]i, the optimal quantizers 
(f>f,4>gi,4>g2 become 0/ j '/'gi i ^^'gs described in Section Hill 
Since (j)*^ or cj)*^ only involves two densities, the correspond- 
ing result follows immediately from the optimality of MLRQ's 
established in Tsitsiklis [6]. Therefore, it remains to show that 



0/ = 0/' 

which will be proved in the next subsection. 



(11) 



C. Optimal Quantizer with respect to f 

The main objective of this subsection is to prove (fTTl i. i.e., 
the optimal (randomized) quantizer 4>f{x) with respect to / 
becomes the deterministic quantizer (j)j{x) = I{x > 0) when 
/ = iV(0, l),gi = Ni-1, 1) and g = 7V(1, 1). 

To prove this, for a given deterministic quantizer e 
define for i = 0, 1, 

qt{(l)\(p) =P^((/>(X) =i) and qi(l)\(p) = (gol'/'I'p), 9i(0|<^)), 



where e {f, 91,92}, and denote 

<z(<^) = ((Z(</)|/);g(0|5i);g(</'|52)), 



(12) 



then q{(j)) completely characterizes the distribution of quan- 
tized message induced by the deterministic quantizer 0, in 
the sense that if q{cj)i) = q{4>2), the quantized data 4>i{X) 
and (l)2{X) have the same distribution, which implies that 

/*K/,5i)-/^^(/,52). 
Let 

Q = {'z('^),0e*} 

be a subset of and Q be the convex hull of Q. (Here we 
do not use the usual symbol Q to avoid confusion with $.) 
For g e as in (l8]l and (fT2T i. define q ~ ((?(/); (7(51); 9(52)) 
and 



E log #^ 

i=0 



(13) 



and quantities such as /'(/, 9i) with i = 1 or 2 in an obvious 
extension. Note that the K-L definition in ( fT3] l is consistent 
with that in since for a deterministic quantizer <j), we have 

I'^^^Kf,9i)^lHf,9i)- 

Now let us state the concept of unambiguous likelihood 
quantizer (ULQ) proposed in Tsitsiklis [6]. Let 



m/f{x) 



1,2. 



l + 9i{X)lf{X)+g2{X)/f{Xy 

In our context (also see Lemma |2] below), a quantizer G $ 
is a ULQ if there exists real number ao, ai, 02 such that 

<j){X) = I{ao + aiViiX) + a2V2{X) > 0) (14) 

and for if e {f,9i,92}, 

F^{ao + aiVi{X)+a2V2{X) = 0)=0. (15) 

Lemma 1. Let cj) G ^ be a ULQ, then up to a permutation of 
the values it takes, w.p.l (under all f, 91,92)- 

(t>{X) = I{Xi < X < X2) or <f){X) = I{X > X). (16) 

Proof: As X goes from —00 to 00, both 1 — vi and 
V2 strictly increase from to 1. Hence it suffices to show 
(j){X) = I(ti < vi{X) < t2) with Q<ti<t2<l. 

By (O and ( fTSI l, ULQ's can be interpreted as: draw a 
straight line on which intersects {{vi{X),V2{X))} at a 
zero-probability set (under all /,. 91,(72), 4> will take value 

if {vi,V2) stays in one side of the line and take value 1 if it 

,2 

stays in the other Since ^^^jy- < for any < ui < 1, a line 
intersects {{vi{X),V2{X))} at at most two points, and thus 
relation ( fTSI l holds. ■ 
The following lemma shows that the best quantizers can be 
found from the class of the ULQ's. 

Lemma 2. For a given quantizer e $, there always exists 
another quantizer (/)' € ^ that assigns probability masses only 
to the ULQ's and 



Proof Let be the exposed points of Q, then by 
Corollary 5.1 of Tsitsiklis [6], q £ Qa if and only if there 
exists a ULQ (j) such that q = q{4)). By the compactness of 
the set {{vi{X),V2{X)y\ , it is straightforward to show that 
Qa is identical with the extremal points of Q. 

From (IS), it is sufficient to prove dTTI i for deterministic (f). 
By the extreme properties of the ULQ's, there exist ULQ's 
(pi, . . . , (f>n and positive number pi, . . . , p„ such that 

n n 



k=l 



k=l 



Let 4)' be a random quantizer assigning mass pi to for 
i = 1,. . . ,71. By dill, for i = 1,2, 

n 

fc=i 



Proof of Relation ( 1771 ) .- By Lemma |2| 0/ can be 
achieved by randomizing ULQ's of the form (t>{X) = 
I{X > A) or = /(Ai < X < A2). Since 

sup0e4,{min{/'^(/,5i),/'^(/,52)}} must be reached on the 
boundary of a two dimensional convex set, it suffices to focus 
on quantizers that randomize between at most two ULQ's. 

Numerically, we can simply optimize over discrete (finite) 
sets Hi = {A, : A^ € R}_and U2 = {(Ai,,,A2,,) : Ai^^ < 
A2,i}- Foi" each quantizer cj) that randomize between at most 
two ULQ's (with the values of A and (Ai,A2) in Hi or 112, 
respectively), we can calculate the value 

min{/^/,gi),/^(/,52)}, 

and the quantizer 4> with the maximum value will be the ap- 
proximation of the best quantizer. Our numerical computations 
support the optimality of quantizer 4'*j:{X) — I{X > 0) in the 
sense of (|9|l to the precision of four digits after the decimal 
point. ■ 

IV. Invariant Tests 

One popular approach to tackle hypothesis testing with 
composite hypotheses is the principle of invariance, see for 
example Lehmann [4]. In our case, the two densities in Hi 
are reflections to each other, so if we pretend that {|X„|} are 
taken as the raw data, the problem in ([T]) becomes a simple 
hypothesis-testing problem with 

Ho: |X„|^/ and H^ : \X,,\ ^ g, 

where / and g are probability densities of the forms: 
2 



/2tt 
1 

7^ 



— l{x > 0} 



-)l{x > 0}. 



I^'{f,9^)>IHf,9^)■, «=1,2. 



(17) 



Therefore, with |X„|, we can develop "good" decentralized 
invariant sequential tests based on the asymptotic optimality 
theory in Mei [5]. Below we will use the same notation as in 
previous sections, for instance, denote by N the sample size. 



and denote by ttj ^ and tt^ „ the posterior distributions, resp. 
Similarly, {Wj, Wg} is the cost of making incorrect decisions. 

Let us consider the decentralized invariant test with station- 
ary quantizers of the form C/„ — I{\Xn\ < A). In this case, the 
quantized sensor messages C/„'s are i.i.d. (conditioned on each 
hypothesis) and the fusion center faces a classical sequential 
hypothesis testing problem. Thus the optimal policy at the 
fusion center is an SPRT based on C/„'s. That is, the fusion 
center stops taking observations at time 

TV - min{n > 1 : ^ (c, -)}, 

and decides Hq (Hi) is true if upper (lower) bound is crossed. 
Hence, in the following we will we pay special attention on 
how to choose a quantizer of the form C/„ = < A). 

Under our setting, one natural choice of quantizer is 

<0.5) (18) 

and denote by {(5//(c)} the corresponding decentralized test 
with an SPRT at the fusion center 

By asymptotic optimality theory in Mei [5], a better choice 
of A is to find one value that minimizes 

where f\ and g\ are the probability mass functions induced 
on Un — I{\Xn\ < A) when the distribution of is / and 
g. A simple numerical simulation shows that the best value is 
A = 1.2824, and 

0*(|X|) = < 1.2824). (19) 

Denote by {(^///(c)} the corresponding decentraUzed test with 
an SPRT at the fusion center. 

V. Simulation 

In this section we compare the three tests proposed in 
previous sections through numerical simulation. We fix a priori 
distribution tt/ — -Kg^ = iTg^ = 1/3 in our problem (by 
Theorem [U this is not essential). This leads to ttj = 1/3 
and TTg ~ 2/3 for the invariant tests in Section HV] In 
our simulations, the cost of making incorrect decisions are 
assumed to be 1, and we consider three different values for 
the cost of taking an observation: c — 10^^, 10"'^, 10"''. In 
our proposed test <5/(c), it has an additional parameter u{c) 
satisfying the conditions in Q, and in our simulations we 
assume that u(c) 0.1. 

Table |l] and |ll] report numerical simulations on 
P(decision incorrect) and the expected sample sizes E(iV). 
Since the probabilities of incorrect decisions are small, we 
use the importance sampling approach to simulate P(DI). 

For c = 0.01, we have 7^c((5/(c)) = 0.204, 7^c((5//(c)) = 
0.949, 7^c((5///(c)) = 0.465. Hence, the test {(5//(c)} with 
the intuitive choice of the quantizer in (fTSl l leads to a poor 
performance in terms of Bayes risk. Meanwhile, the test 
{^///(c)} with the "best" invariant quantizer in (19[ has a 
better performance, and our proposed test {Si{c)} in Section 
III is the best among all three tests. 



TABLE I 

Expected Values of Sample Sizes 
E(N) = nfEf{N) + ng. Eg, (N) + ng.Eg, (N) 



E(7V) 


c= 10-2 


c = 10-3 


c = 10-* 


Sdc) 


20.2 ± 0.2 


28.4 ±0.2 


36.3 ±0.2 


Siiic) 


94.1 ± 0.7 


146.0 ±1.0 


196.4 ±1.0 


Si 11(c) 


45.7 ±0.5 


69.0 ±0.5 


92.2 ±0.5 



TABLE II 

Probabilities Of Making Incorrect Decisions 



P(DI) 


c = 10-2 


c = 10-3 


c = 10-* 


Si{c) 


4.58 ± 0.03e-3 


4.42 ± 0.03e-4 


4.61 ± 0.03e-5 


Si lie) 


8.84 ± 0.02e-3 


8.85 ± 0.02e-4 


8.84 ± 0.02e-5 


Siii{c) 


8.02 ± 0.02e-3 


8.03 ± 0.02e-4 


8.02 ± 0.02e-5 



VI. Conclusion 

In this article, the problem of decentralized testing compos- 
ite hypotheses in sensor networks is studied through a concrete 
example on testing a normal mean. Asymptotically Bayes tests 
{(5/(c)} are constructed through a characterization of ULQ's. 
Contrary to our intuition, the quantizers are still of the form 
I{Xn > A). By exploiting the symmetries, we also investigate 
invariant stationary SPRT's. Numerical simulations confirm 
the significant advantages of our proposed test {6j{c)}. 

While we only consider a special problem of testing a 
normal mean, the essential ideas can be easily extended to 
other general distributions or the problem of testing K (K > 
3) hypotheses. It will be interesting to understand when is 
possible to characterize the ULQ's as in ( fTSl l. Another natural 
extension is to study the networks with multiple sensors, where 
different sensors may use different quantizers. The details will 
be investigated in our future research. 
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